Proposition de cadres d'évaluation d'un système de RI personnalisé

The evaluation of a personalized search systems aims at measuring its performance. Traditional laboratory-based evaluation of the information retrieval systems is challenged because of its lack of user evidence expressing his search context in the data test sets. In this paper, we present evaluation protocols of personalized search system based on enhancing TREC collections with simulated contexts/user profi les. An evaluation protocol based on TREC adhoc consists of building the user profi le across simulated search sessions designed by the TREC domains. Another evaluation protocol based on TREC-H ARD consists of building the user profi le across simulated search defi ned by the topics of the collection. Experimental results show the stability performance of our personalized search system according to the proposed evaluation protocols using different test collections. MOTS-CLÉS : Système RI personnalisé, cadre d’évaluation, profi l utilisateur